Supervised Hebbian learning
نویسندگان
چکیده
In neural network's Literature, Hebbian learning traditionally refers to the procedure by which Hopfield model and its generalizations store archetypes (i.e., definite patterns that are experienced just once form synaptic matrix). However, term "Learning" in Machine Learning ability of machine extract features from supplied dataset (e.g., made blurred examples these archetypes), order make own representation unavailable archetypes. Here, given a sample examples, we define supervised protocol network can infer archetypes, detect correct control parameters (including size quality dataset) depict phase diagram for system performance. We also prove that, structureless datasets, equipped with this rule is equivalent restricted Boltzmann suggests an optimal interpretable training routine. Finally, approach generalized structured datasets: highlight quasi-ultrametric organization (reminiscent replica-symmetry-breaking) analyzed datasets and, consequently, introduce additional "replica hidden layer" (partial) disentanglement, shown improve MNIST classification 75% 95%, offer new perspective on deep architectures.
منابع مشابه
Robustness of Hebbian and Anti{hebbian Learning
Self{organizing neural networks with Hebbian and anti{Hebbian learning rules were found robust against variations in the parameters of neurons of the network, such as neural activities, learning rates and noisy inputs. Robustness was evaluated from the point of view of properties of soft competition for input correlations. Two models were studied: a neural network with presynaptic Hebbian learn...
متن کاملBeyond Hebbian plasticity: Effective learning with ineffective Hebbian learning rules
In this paper we revisit the classical neuroscience paradigm of Hebbian learning. We find that a necessary requirement for effective associative memory learning is that the efficacies of the incoming synapses should be uncorrelated. This is difficult to achieve in a robust manner by Hebbian synaptic learning, since it depends on network level information. Effective learning can yet be achieved ...
متن کاملAssociative Learning: Hebbian Flies
Fruit flies can learn to associate an odor with an aversive stimulus, such as a shock. New findings indicate that disrupting the expression of N-methyl-D-aspartate (NMDA) receptors in flies impairs olfactory conditioning. The findings provide support for a critical role for NMDA receptors in associative learning.
متن کاملDifferential Hebbian Learning
The differential Hebbian law ~.. = C.. 6. is examined as an 13 1 j alternative to the traditional Hebbian law ~.. = C.C. for 13 1 J updating edge connection strengths in neural networks. The motivation is that concurrent change, rather than just concurrent activation, more accurately captures the "concomitant variation" that is central to inductively inferred functional relationships. The resul...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: EPL
سال: 2023
ISSN: ['0295-5075', '1286-4854']
DOI: https://doi.org/10.1209/0295-5075/aca55f